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Abstract 

Two-dimensional topological insulators are characterized by gapped bulk 
states and gapless helical edge states, i.e. time-reversal symmetric edge states 
accommodating a pair of counter-propagating electrons. An external mag- 
netic field breaks the time-reversal symmetry. What happens to the edge 
states in this case? In this paper we analyze the edge-state spectrum and 
longitudinal conductance in a two-dimensional topological insulator subject 
to a quantizing magnetic field. We show that the helical edge states exist also 
in this case. The strong magnetic field modifies the group velocities of the 
counter-propagating channels which are no longer identical. The helical edge 
states with different group velocities are particularly prone to get coupled 
via backscattering, which leads to the suppression of the longitudinal edge 
magnet o conduct ance . 

Keywords: topological insulators, quantum spin Hall effect, quantum Hall 
effect, Dirac fermions 



1. Introduction 

The discovery of two-dimensional (2D) [H, Q, 0] and three-dimensional 
(3D) 0, @, 0, S] topological insulator phases in materials with strong 
spin-orbit coupling has stimulated vigorous research in this field 



Topological insulators (TIs) are distinct from ordinary band insulators and 
semimetals by the presence of protected surface (in 3D) or edge (in 2D) states. 
In a 3D TI the surface state has a Dirac-cone spectrum with zero band gap 
as a consequence of time- reversal symmetry (TRS). If TRS is broken, an 
energy gap is induced at the Dirac point, and the surface state exhibits the 
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14j . |15[ [16[ and rich magneto-electric phe- 
17l Il8l . Il9l ] related to axion electrodynamics [21 



The 2D TIs have been realized in HgTe/CdTe quantum wells (QWs) 



211 ] . Their electronic bands form a single double-degenerate Dirac valley [22]. 
The double degeneracy of the QW bands allows for an energy gap at the 
Dirac point without TRS breaking, so that the conduction electrons mimic 
the behaviour of massive Dirac fermions with specific mobility [23[ and weak 
antilocalization effects [24j. The unique feature of the HgTe/CdTe QWs is 
that their band gap inverts its sign upon changing the thickness of the HgTe 
layer 3 1 . The topologically nontrivial phase - the quantum spin Hall (QSH) 
state 1 



0, 0, 21] - occurs when the Fermi level lies within the inverted band 
gap and is characterized by gapless quasi-one-dimensional states on sample 
edges, while the states in the 2D bulk are fully gapped. Unlike the chiral 
QH edge states [25|, |26| the edge modes of a QSH insulator possess the TRS 
because they accommodate counter-propagating opposite-spin electrons and, 
for this reason, are frequently, called helical. One particular consequence of 
the TRS is that the counter-propagating helical channels have the same group 
velocities. 

In experiments on HgTe/CdTe QWs [^], the QSH state was detected by 
measuring the longitudinal electric conductance of two spin channels propa- 
gating in the same direction on opposite edges of the sample. This finding 
was further substantiated by the observed suppression of the edge transport 
in an external magnetic field ji[ , which is expected since the magnetic breaks 
the TRS. However, the concrete scenario of the TRS breaking may depend 
on a number of poorly controlled factors such as the degree of bulk-inversion 
asymmetry, strength and type of disorder 27], l28l |. which require further in- 
vestigations. 

In this paper we characterize the TRS breaking in the QSH regime in 
terms of the modification of the edge-state dispersion in a magnetic field. 
We demonstrate that the counter-propagating helical edge states persist in a 
strong quantizing magnetic field due to the fact that they are protected by the 
band gap. However, they have now distinctly different group velocities: One 
of the edge modes merges with the bulk lowest Landau level and therefore 
becomes slower than the other (see also Fig. [T|). At the band gap energy 
(corresponding to the bulk lowest Landau level) the edge spectrum changes 
from helical to chiral. Such a transformation occurs as the Fermi level is 
driven from the band gap into the Landau-quantized conduction or valence 
band where a dissipationless QH state sets in. We find that in the QSH 



2 



regime (i.e. below the band gap) the "slow" and "fast" edge modes are prone 
to get coupled by weak disorder that generates backscattering between the 
counter-propagating channels. This leads to suppression of the two-terminal 
longitudinal edge conductance g as a function of both Fermi energy and 
magnetic field B: 

g(e,B)cx(\M\-\e\) 2N /B 2N , \e\-+\M\. (1) 

Here e indicates the position of the Fermi level with respect to the band 
gap energy \M\. Equation (JTJ contrasts the behaviour of the zero-field con- 
ductance which increases as the Fermi level is pushed into the metallic-type 
conduction or valence band |3| . l2l| . Also, unlike the exponential B decay in 
strongly disordered systems |27j] , Eq. ([TJ describes a power-law magnetocon- 
ductance. 

Equation (jTJ) assumes the presence of a few (N) backscattering centers 
on the edge such as sample inhomogeneities where electronic trap states can 



interact with the edge channels randomizing their propagation directions 21 
Although in a zero field this effect is believed to be weak, we show that 
near the band gap the backscattering is dramatically enhanced due to the 
flattening of the dispersion of one of the coupled QSH modes. According to 
Eq. ([I]), the analysis of the power of the magnetoconductance decay can be 
a useful tool to determine the quality of the QSH devices. 



2. From helical to chiral edge states in a quantizing magnetic field 

2.1. Boundary problem and its solution 

We will first analyze the edge states in scattering-free HgTe QWs using 
the effective 4-band model derived in Ref. [2j. In this approach one works in 
the basis of the four states near the V (k = 0) point of the Brillouin zone: 
l e i+}> 1^-1+)) l e i~ }j an d \h\— }, where t\ and h\ are the s-like electron and 
p-like hole QW subbands, respectively. The index r = ± accounts for the 
spin degree of freedom. The effective 2D Hamiltonian can be approximated 
by a diagonal matrix in r space jij; 

H = ( k h* ) ' hk = dkCr ' dk = ( hvkxi ~ hvk y M )- ( 2 ) 

where Pauli matrices o~ Xj y iZ act in subband space, v ~ 5.5 x 10 5 ms _1 is the 
effective velocity [ij], and M determines the band gap E g = \M\ at k = 0. In 
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Eq. ([2]) we omit the terms oc k 2 , which are small near the T point, and assume 
no coupling between the Kramers partners, which is a good approximation 
for symmetric HgTe quantum wells 22|, |29| ■ Up to a unitary transformation, 
Eq. ([2]) is equivalent to a massive Dirac Hamiltonian 



H D = hvr z crk + Mr z a z , 



(3) 



t z is the Pauli matrix in spin space. Following the previous studies of edge 



states in graphene [30|, |31 



32l . |33[ |34| | we will work with the matrix retarded 



Green's function defined by the equation 



[eI-H D ]G(r,r')=I5(r-r'), 



(4) 



where k = — zV — eA(r)/cE, A(r) = (—By, 0,0) is the vector potential of 
an external magnetic field B, and I = tqctq = diag(l, 1, 1, 1). Assuming a 
sufficiently wide sample, we find G(r, r') near one of the edges, e.g. y — 0, 
using the boundary condition 



G(r,r') 



y=0 



T a x G(r, r') 



y=o, 



(5) 



equivalent to confinement by infinite "mass" at y < [35]. This boundary 
condition can be obtained by introducing a large mass term (M — > oo) 
outside the physical area of the system 3g|. Our results do not however 
strongly depend on the choice of the boundary condition since the origin 
of the QSH edge states is topological: a mass domain wall in the inverted 



regime with M < in the bulk [2|, |36 . 

The matrix G = diag(G + , G_) is diagonal in r space, and each G T can 
be diagonalized in e,h space: 



G T 



Gee\r G e fi\ T 
Ghe\r Ghh\r 



V{p x +jpy) 
Tt+AI 




G 



hh\r 



(6) 
(7) 



Expanding G in plane waves e lkx yields the boundary problem for the diag- 
onal elements: 



pp. _ (z-zk.y 

u z 4 
9 Z G ' ee \rk 



G 



ee\rk 



\(e+tM) 



<? G ee \ T k\ z=Q , q 



Xk, 



Mre+M) 
hv 



(8) 
(9) 



4 



with z = y/X, z k = -2Xksgn(eB), X = ^ch/2\eB\, and a = X 2 (M 2 - 
e 2 )/h 2 v 2 — sgn(eS)/2. The equations for Ghh\rk are obtained from Eqs. (JED 
and <M} by replacement r,k,B — > — r, —k, —B. The detailed solution to 



Eqs. ([8]) and has been given in Ref. 37]. The outcome of these calculations 



is that the Green's function G ee \ rk can be expressed in terms of the parabolic 
cylinder function U(a, z) [38[ as follows 

r - r°° f v J\ _ n d Zk U(a, z k ) + qU(a, z k ) 

Gee\rk ~ G^Z, ) C Qjj^^J^^ 

x U{a,z - z k )U{a,z' - z k ). (10) 

The last term is the contribution of the edge, whereas 

GTe\rk = C[G(z-z')U(a,z-z k )U(a,-z' + z k ) 

+ Q(z' - z)U(a,z' - z k )U(a,-z + z k )], (11) 
C = -A(e + tM)T(cl + 1/2)/V2tt^V, (12) 

is the Green's function of the unbounded system (source term), where T(a + 
1/2) is Euler's gamma function. We then insert G ee \ Tk and Ghh\jk into Eq. (J7J) 
and eliminate all the derivatives, using the recurrence relations [38[ for U (a, z) 
and assuming, for concreteness, eB > 0. As a result, the edge contribution 
takes the following form: 

a(zz')( 1 W 
° Tk ~ e — tM — T(hv/X)U(a, -z k )/U(a + 1, -z k ) ' (13) 
with functions a(z, z') and f3(z) given by 

n i 7 j\ _ U(a,z-z k )U{a,z' -z k ) 

K ' ' \U(a,-z k )U(a + l,-z k y { ' 

a , v t/(a, -z k )U(a + l,z - 

U(a + 1, -z k )U{a, z - z k ) 

The new feature of solution ffl3|) is that it is valid for an arbitrary parameter 
hv/X\M\ which measures the magnetic field strength. Below we compare 
weak- and strong-field regimes defined by hv/X\M\ < 1 and hv/X\M\ 3> 1, 
respectively. 
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2.2. Edge states: weak- and strong-field asymptotics 

The edge-state spectrum is given by the poles of Eq. (fl3|) . i.e. by the 
zeros of the equation 

e - tM - T(hv/X)U(a, -z k )/U(a + 1, -z k ) = 0. (16) 

This equation describes the transition from the band insulator with M > 
to the QSH state with M < [cf. Figs. Offa) and (b)], which is observed at 
the critical QW thickness ~ 6.3 nm [2j, yf. The QSH state has two gapless 
counter-propagating spin channels which are exponentially localized at the 
edge for weak magnetic fields, as seen from Eq. ([TBI and Fig. [2] where we 
use the asymptotic formula U(a, z) « v /7r/[2 a / 2+1 / 4 r(3/4 + a/2)]e~^ z with 



a | ^> 1 38], valid for low fields and energies |e| < \M\: 



Tfc e-rMQ{M)-Thv{k-k B y \\M\ K ' 

The subgap edge-state dispersion is linear: e Tk = rhv{k — ks) for M < 0. 
The magnetic field only shifts the zero-energy point ks = —eBv/(2c\M\) 
with no effect on transport. 

As the magnetic field does not open a gap, the QSH state persists in strong 
fields hv/X\M\ 3> 1, though the QSH channels are no longer localized at the 
edge [see, solid curves in Fig. |2j. The electron function G ee (z, z) oc a(z,z) 
for eB > [or the hole one Ghh{z,z) for eB < 0] behaves almost like the 
lowest-Landau-level bulk wave function peaked at the center of oscillator 
z k . The other functions are small at z ~ z k . The strong- field asymptotic 
is obtained for U(a,z) « U(-l/2,z) = e"^/ 4 , U(a + l,z) « 17(1/2,*) = 
e^/ 4 v /^72erfc(2/ v / 2), and < 1 in Eqs. ([TBI and (PT41): 

Gr/t ~ — ^— — -G rk} G T k(z 1 z') = —^ — -, (18) 

/T e -(^-^) 2 /4-(^'-^) 2 /4 

a(z,z')*t\ = — , (19) 

V ; V 7T Aerfc(-z fc / v / 2) 

ert = TM + ^____, _»!, (20, 

where erfc(z) is the complementary error function. However, the most essen- 
tial distinction of this regime is the nonlinear spectrum ( 1201) . Upon crossing 
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the gap energy e = \M\ it changes from helical to chiral, as illustrated in 
Fig. QJc). Therefore, the QSH state transforms into a dissipationless v = 1 



QH state [25|, [26|. The transition between the QSH and QH regimes can be 
accessed experimentally through the gate-voltage (i.e. energy) dependence 
of the longitudinal magnetoconductance. To analyze such a dependence (see 
next section) we will need the group velocities, v±(e,B) and the center-of- 
oscillator coordinates, z±(e, B), which are obtained from Eq. (12"U1) linearized 
near given energy, 

t T k ~ e - (hv T /2\)(z k - z T ). (21) 

Here z T (e,B) is the solution of equation e T k = e, which is related to the 
velocity by 

v T (e, B) = 2X(t\M\ + e) z T (e, B)/h. (22) 

Consequently, in strong fields the edge state can be described by the one- 
dimensional Green's function, 

/Hh f°° 
J d yG Tk (y,y), (23) 

where G r k(y,y) is localized within A [see, Eq. f|T9|) ]. Using the linearized 
dispersion (|2T]) we find 

G T {x,x') = Q{[x - x']r)e ikTie ' B){x - x,) /ih\v T {e,B)\, (24) 

where the unit-step function Q([x — x']r) accounts for the chirality and wave 
vector k T = —z T /2X is related to the center-of-oscillator coordinate obtained 
numerically as discussed above. 

3. Backscattering of helical edge states and magnetoconductance 

We now calculate the two-terminal magnetoconductance of a QSH system 
in the presence of backscattering centers, i.e. defects causing the scattering 
between the counter-propagating channels [see, Fig. [3]. Microscopically, such 
scattering can be mediated by interaction with electronic trap states which 



are likely to exist even in high quality samples |21l . I39l |. Since the edges 



are assumed decoupled, it is sufficient to do the calculation for one of them, 
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e.g., for the lower edge in Fig. [3J The scattering matrix for the edge can be 
decomposed in two parts: 



S = S=(g (25) 

The first factor (cr + cr z )/2 is the projector on the electron QW subband 
which has the non-vanishing wave function in the strong magnetic field [cf. 
Eq. (Tl8l) ]. The second factor S is the scattering matrix connecting right 
("+")- and left ("-")- moving electron states with corresponding reflection r 
and transmission t amplitudes. The conductance can be calculated as 

9 = (e 2 /h)\t++\ 2 , (26) 



using Fisher-Lee relation [40| . 

t++ = ih\v+\g ++ (x eR,x G L), (27) 
between and the diagonal element Q ++ (x, x') of the Green's function, 

g{x > x) -{g- + (x,x') g-M )■ (28) 

which is a matrix in space of the right- and left-movers and has off-diagonal 
elements due to backscattering. We model the backscatterers by the sum 
of iV potentials, localized at positions x n with non-zero matrix elements V n 
between the right- and left-moving states: 

V( x ) = y2 VJ{x-x n )r x . (29) 

Note that choosing the other off-diagonal matrix, r y does not change the final 
result. 

Potential V(x) (129]) results in the Dyson equation 

g(x,x r ) = G(x,x') + ^2 G(x,x n )V n T x g(x n ,x r ), (30) 

n=l..N 

where 
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is the Green's function matrix in the absence of scattering [see, Eq. f!24p ]. Us- 
ing Eqs. (1291 . (13"U1) and (I3~il we obtain the coupled equations for the diagonal 
Q ++ (x,x') and off-diagonal Q- + (x,x') elements: 

G++(X, X 1 ) = G+(X, X 1 ) + ^ G +( X i Xn)V n G- + (x n , X'), 

n 

Q- + {x,x') = ^ G-(x,x n )V n Q ++ (x n ,x'). 



Eliminating Q_ + {x,x > ) yields a closed equation for Q ++ (x, x'): 

Q ++ (x,x') = G + (x,x') + 

+ ^ G-\-{x, x n )V n G— (x n , x m )V m Q++( K x m , x ). 



(32) 



With known unperturbed function G T and for not large N, we solve this 
equation and calculate g. Let us look first at the particular cases N — 1,2 
and 3: 



h \ H 2 \v + v. 



(33) 



h 



V 2 + V 2 + V x V 2 e iQd ^ V?V 2 



h 2 \v + v_ 



+ 



Wv 2 v 2 



(34) 



9 = J 



1 + 



h 6 \v + v- 1 3 



En=i K 2 + ^y 2 e Wu + W 3 e iQdl3 + V 2 y 3 e iQd23 



V?V 2 + If V 3 2 + V 2 V 2 + y 2 ^3e^ d23 



where Q = k + — k_ and d nm = x m — x n . 

Clearly, for arbitrary N the conductance contains the cross product V 2 ■ ■ ■ V^/\v + v_\ N 
arising from the simultaneous scattering from N potentials. This is the most 
divergent term when one of the velocities v± vanishes near the band gap, 



(35) 
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|e| — )■ Eg = \M\ (e.g. t;_ — >■ in Fig. DJc)). Such strong enhancement of the 
backscattering leads to the suppressed conductance, 

g « {e 2 /h) x ^lu+u-l 2 ^/^ • • • Vat) 4 < e 2 //i. (36) 

Using Eq. (122)1 we obtain the qualitative energy and field dependence of the 
conductance discussed earlier in the introduction [see, Eq. (pQ)]. 

In a wider range of energies and fields the typical behavior of the conduc- 
tance can be understood from Eq. (134)) assuming two backscattering centers 
on the edge. First of all, it is easy to verify that Eq. (|34p is valid not 
only for strong fields, but also in the weak-field case where the unperturbed 
Green's function is given by Eq. ( ITT)) . Since the weak-field spectrum is lin- 
ear e T k = rhv(k + ks), we have v + = — v, k± — —ks ± e/hv and 
Q = k + — = 2e/hv. Therefore, g is independent of the magnetic field and 
for Vi t 2 <C hv is almost independent of energy (see dashed curve in Fig. BJ. 
Thus weak channel mixing is hardly detectable for small B. Also, since we 
focus on the quasi-ballistic systems with just a few backscatteres, there is 
no gap opening in this case [this conclusion may no longer be true for sys- 
tems with a sizable macroscopic number of such defects]. In contrast, in 
strong magnetic fields, scattering of the same strength is sufficient to sup- 
press the conductance, g near the band gap where the QSH-QH transition 
occurs [cf. dashed and solid curves for = 0.01 meV-/zm near \M\ = 1.5 
meV in Fig. H] . Figs H] and [5] also show that the conductance suppression 
is accompanied by Fabry- Perot-type oscillations due to interference of the 
counter-propagating channels which acquire the energy- and field-dependent 
phase difference {k + — k_)di 2 , in scattering between the defects. 

In our model the upper magnetic field limit lies in the range of a few 
Tesla. This estimate is based on Refs. 0, |4l[ predicting another (_B-field 
induced) QSH-QH transition due to a quadratic correction Bk 2 to the mass 
term in Eq. fl2]). The smallness of the parameter B\M\/2h 2 v 2 < 1 @, SH 
allows us to neglect such k 2 term and to meet, at the same time, the strong 
field condition hv/X\M\ > 1. 

4. Conclusions 

We have studied helical edge channels and their longitudinal conductance 
in a two-dimensional topological insulator subject to strong quantizing mag- 
netic fields. The helical edge channels consist of a pair of counter-propagating 
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states that exist within a bulk band gap of the topological insulator. We 
have shown that, albeit persistent in a strong magnetic field, the counter- 
propagating states acquire different group velocities. In particular, at the 
band gap the helical spectrum turns chiral: one of the edge states merges 
with the dispersionless bulk Landau level, whereas the other remains propa- 
gating, which corresponds to the onset of the v — 1 quantum Hall state. Due 
to the drastically different group velocities of the helical modes, the longitudi- 
nal conductance is very sensitive to backscattering that couples the counter- 
propagating channels. We have found that in the presence of backscattering 
the longitudinal conductance rapidly decreases as a function of both Fermi 
energy and magnetic field. It shows a power-law magnetic field dependence 
B~ 2N , determined by the number N of backscattering centers on the edge. 
This suggests a simple way to detect such defects in ballistic QSH devices 
using standard magnetoresistance measurements. 

Our findings may have implications for the studies of other related phe- 



nomena in HgTe quantum structures (see e.g. Refs. |42|, |43J) including hy- 
brid structures such as topological insulator /superconductor junctions. In 
hybrid structures consisting of conventional two-dimensional semiconductors 
and supersonductors the magnetotransport is strongly influenced by Andreev 



reflection [441 . 1451 . 146l 1471 . 1481 . |49| . |50| , whereby Cooper pairs are transferred 
between superconducting and normal regions. Since topological insulators 
differ markedly from conventional semiconductors, our analysis may help to 
understand Anreev magnetotransport through helical edge channels. 

We thank S. C. Zhang, Q.L. Qi, J. Maciejko, A. Novik, H. Buhmann, LW. 
Molenkamp, B. Trauzettel and A. H. MacDonald for helpful discussions. This 
work was funded through DFG Grant HA5893/1-1. 
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Figure 1: Edge-state energy as a function of center-of-oscillator coordinate Zk = 
— 2Afcsgn(eS) where k is the wave vector along the edge: (a) ordinary band insulator 
and (b) QSH insulator with two counterpropagating (helical) gapless states merging with 
flat bulk Landau levels at large Zk\ Hv/X\M\ = 0.5 and eB > 0. (c) Edge states in a strong 
magnetic field (hv/X\M\ > 10). Helical spectrum turns chiral at band gap energy e = \M\. 
Points indicate numerical solution of Eq. (|16p . whereas solid lines are the analytical result, 
Eq. ([20]). 
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Figure 2: Spatial distribution of edge states in weak (dashed curves) and strong (solid 
curves) magnetic fields at zero energy (e = and M < 0) [see, Eqs. ©, (fT5]) and text], 
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Figure 3: Two-terminal QSH system in a strong perpendicular magnetic field. Edge 
channels are localized within the magnetic length A. Light blue regions schematically 
indicate backscattering centers (see also text). We assume that the current is carried 
by the right moving states (solid arrows ±), populated in contact L and equilibrating in 
contact R. 




Figure 4: Conductance [see, Eq. (j34|) ] versus energy below band gap \M \ = 1.5 meV. 
Scattering potential strengths V1.2 are in units of meV-/im; d\2 = 3y«m. 
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Figure 5: Conductance [see, Eq. ([34]) ] vs. magnetic field for different energies within the 
band gap: (a) e = 0.2 meV and (b) e = 1 meV. Labels 1, 2 and 3 refer to scattering po- 
tential strengths V\ = V% = 0.06, V± = V2 = 1 and V\ = V2 = 0.15 meV-/im, respectively; 
di2 — 3/im. 
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